accelerate
bitsandbytes
datasets
deepspeed==0.15.0
einops
flash-attn
isort
jsonlines
loralib
optimum
packaging
peft
ray[default]==2.12.0
torch
torchmetrics
tqdm
transformers==4.44.2
transformers_stream_generator
wandb
tensorboard
wheel